St. John's
- North America > United States > California (0.14)
- North America > Canada > Newfoundland and Labrador > Newfoundland > St. John's (0.04)
- Asia > Thailand > Bangkok > Bangkok (0.04)
A Comparative Study of EMG- and IMU-based Gesture Recognition at the Wrist and Forearm
Baghernezhad, Soroush, Mohammadreza, Elaheh, da Fonseca, Vinicius Prado, Zou, Ting, Jiang, Xianta
Gestures are an integral part of our daily interactions with the environment. Hand gesture recognition (HGR) is the process of interpreting human intent through various input modalities, such as visual data (images and videos) and bio-signals. Bio-signals are widely used in HGR due to their ability to be captured non-invasively via sensors placed on the arm. Among these, surface electromyography (sEMG), which measures the electrical activity of muscles, is the most extensively studied modality. However, less-explored alternatives such as inertial measurement units (IMUs) can provide complementary information on subtle muscle movements, which makes them valuable for gesture recognition. In this study, we investigate the potential of using IMU signals from different muscle groups to capture user intent. Our results demonstrate that IMU signals contain sufficient information to serve as the sole input sensor for static gesture recognition. Moreover, we compare different muscle groups and check the quality of pattern recognition on individual muscle groups. We further found that tendon-induced micro-movement captured by IMUs is a major contributor to static gesture recognition. We believe that leveraging muscle micro-movement information can enhance the usability of prosthetic arms for amputees. This approach also offers new possibilities for hand gesture recognition in fields such as robotics, teleoperation, sign language interpretation, and beyond.
- North America > Canada > Newfoundland and Labrador > Newfoundland > St. John's (0.04)
- North America > United States (0.04)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
- Health & Medicine > Health Care Technology (0.88)
- Health & Medicine > Therapeutic Area > Neurology (0.48)
- Health & Medicine > Therapeutic Area > Musculoskeletal (0.46)
- (2 more...)
"I Can See Forever!": Evaluating Real-time VideoLLMs for Assisting Individuals with Visual Impairments
Zhang, Ziyi, Sun, Zhen, Zhang, Zongmin, Peng, Zifan, Zhao, Yuemeng, Wang, Zichun, Luo, Zeren, Zuo, Ruiting, He, Xinlei
The visually impaired population faces significant challenges in daily activities. While prior works employ vision language models for assistance, most focus on static content and cannot address real-time perception needs in complex environments. Recent VideoLLMs enable real-time vision and speech interaction, offering promising potential for assistive tasks. In this work, we conduct the first study evaluating their effectiveness in supporting daily life for visually impaired individuals. We first conducted a user survey with visually impaired participants to design the benchmark VisAssistDaily for daily life evaluation. Using VisAssistDaily, we evaluate popular VideoLLMs and find GPT-4o achieves the highest task success rate. We further conduct a user study to reveal concerns about hazard perception. To address this, we propose SafeVid, an environment-awareness dataset, and fine-tune VITA-1.5, improving risk recognition accuracy from 25.00% to 76.00%.We hope this work provides valuable insights and inspiration for future research in this field.
- North America > United States > Hawaii > Honolulu County > Honolulu (0.04)
- Europe > Italy > Lombardy > Milan (0.04)
- North America > United States > Washington > King County > Seattle (0.04)
- (8 more...)
- Research Report (1.00)
- Questionnaire & Opinion Survey (1.00)
- Information Technology > Security & Privacy (1.00)
- Transportation > Infrastructure & Services (0.93)
- Health & Medicine > Therapeutic Area > Ophthalmology/Optometry (0.69)
- Transportation > Ground > Road (0.46)
Autoencoder for Position-Assisted Beam Prediction in mmWave ISAC Systems
El-Banna, Ahmad A. Aziz, Dobre, Octavia A.
Integrated sensing and communication and millimeter wave (mmWave) have emerged as pivotal technologies for 6G networks. However, t he narrow nature of mmWave beams requires precise alignments that typically necessitate large training overhead. This overhead can be reduced by incorpor ating the position information with beam adjustments. This letter propos es a lightweight autorencoder (LAE) model that addresses the position-assi sted beam prediction problem while significantly reducing computational co mplexity compared to the conventional baseline method, i.e., deep fully conne cted neural network. The proposed LAE is designed as a three-layer undercomplete network to exploit its dimensionality reduction capabilities and t hereby mitigate the computational requirements of the trained model. Simulati on results show that the proposed model achieves a similar beam prediction a ccuracy to the baseline with an 83% complexity reduction. This work was supported in part by Natural Sciences and Engin eering Research Council of Canada (NSERC), Discovery program RGPIN-2019-04123 and Canada Re search Chair program CRC-2022-00187.
- North America > United States > Arizona (0.04)
- North America > Canada > Newfoundland and Labrador > Newfoundland > St. John's (0.04)
- Africa > Middle East > Egypt (0.04)
- North America > United States > Illinois > Champaign County > Urbana (0.04)
- North America > United States > New Mexico > Los Alamos County > Los Alamos (0.04)
- North America > Canada > Newfoundland and Labrador > Newfoundland > St. John's (0.04)
- (2 more...)
paper-oras-neurips
Domain decomposition methods are widely used and effective in the approximation of solutions to partial differential equations. Y et the optimal construction of these methods requires tedious analysis and is often available only in simplified, structured-grid settings, limiting their use for more complex problems.
- North America > United States > Illinois > Champaign County > Urbana (0.15)
- North America > United States > New Mexico > Los Alamos County > Los Alamos (0.04)
- North America > Canada > Newfoundland and Labrador > Newfoundland > St. John's (0.04)
- (2 more...)
Low-cost Multi-agent Fleet for Acoustic Cooperative Localization Research
Durrant, Nelson, Meyers, Braden, McMurray, Matthew, Smith, Clayton, Anderson, Brighton, Hodgins, Tristan, Velasco, Kalliyan, Mangelson, Joshua G.
Abstract-- Real-world underwater testing for multi-agent autonomy presents substantial financial and engineering challenges. In this work, we introduce the Configurable Underwater Group of Autonomous Robots (CoUGARs) as a low-cost, configurable autonomous-underwater-vehicle (AUV) platform for multi-agent autonomy research. The base design costs less than $3,000 USD (as of May 2025) and is based on commercially-available and 3D-printed parts, enabling quick customization for various sensor payloads and configurations. Our current expanded model is equipped with a doppler velocity log (DVL) and ultra-short-baseline (USBL) acoustic array/transducer to support research on acoustic-based cooperative localization. State estimation, navigation, and acoustic communications software has been developed and deployed using a containerized software stack and is tightly integrated with the HoloOcean simulator . The system was tested both in simulation and via in-situ field trials in Utah lakes and reservoirs. Effective state estimation for underwater robotics is a challenging problem that is actively being addressed in academic circles.
- North America > Canada > Nova Scotia > Halifax Regional Municipality > Halifax (0.04)
- North America > United States > Utah > Utah County > Spanish Fork (0.04)
- North America > United States > Utah > Utah County > Provo (0.04)
- (10 more...)
- Energy (0.68)
- Machinery > Industrial Machinery (0.49)
- Government > Military (0.46)
- North America > United States > California (0.14)
- North America > Canada > Newfoundland and Labrador > Newfoundland > St. John's (0.04)
- Asia > Thailand > Bangkok > Bangkok (0.04)
paper-oras-neurips
Domain decomposition methods are widely used and effective in the approximation of solutions to partial differential equations. Y et the optimal construction of these methods requires tedious analysis and is often available only in simplified, structured-grid settings, limiting their use for more complex problems.
- North America > United States > Illinois > Champaign County > Urbana (0.15)
- North America > United States > New Mexico > Los Alamos County > Los Alamos (0.04)
- North America > Canada > Newfoundland and Labrador > Newfoundland > St. John's (0.04)
- (2 more...)
Machine Learning and AI Applied to fNIRS Data Reveals Novel Brain Activity Biomarkers in Stable Subclinical Multiple Sclerosis
Islam, Sadman Saumik, Baldasso, Bruna Dalcin, Cattaneo, Davide, Jiang, Xianta, Ploughman, Michelle
People with Multiple Sclerosis (MS) complain of problems with hand dexterity and cognitive fatigue. However, in many cases, impairments are subtle and difficult to detect. Functional near-infrared spectroscopy (fNIRS) is a non-invasive neuroimaging technique that measures brain hemodynamic responses during cognitive or motor tasks. We aimed to detect brain activity biomarkers that could explain subjective reports of cognitive fatigue while completing dexterous tasks and provide targets for future brain stimulation treatments. We recruited 15 people with MS who did not have a hand (Nine Hole Peg Test [NHPT]), mobility, or cognitive impairment, and 12 age- and sex-matched controls. Participants completed two types of hand dexterity tasks with their dominant hand, single task and dual task (NHPT while holding a ball between the fifth finger and hypothenar eminence of the same hand). We analyzed fNIRS data (oxygenated and deoxygenated hemoglobin levels) using a machine learning framework to classify MS patients from controls based on their brain activation patterns in bilateral prefrontal and sensorimotor cortices. The K-Nearest Neighbor classifier achieved an accuracy of 75.0% for single manual dexterity tasks and 66.7% for the more complex dual manual dexterity tasks. Using XAI, we found that the most important brain regions contributing to the machine learning model were the supramarginal/angular gyri and the precentral gyrus (sensory integration and motor regions) of the ipsilateral hemisphere, with suppressed activity and slower neurovascular response in the MS group. During both tasks, deoxygenated hemoglobin levels were better predictors than the conventional measure of oxygenated hemoglobin. This nonconventional method of fNIRS data analysis revealed novel brain activity biomarkers that can help develop personalized brain stimulation targets.
- North America > Canada > Quebec > Montreal (0.05)
- Europe > Germany > Berlin (0.04)
- North America > Canada > Newfoundland and Labrador > Newfoundland > St. John's (0.04)
- (4 more...)
- Research Report > Strength High (1.00)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study > Negative Result (0.46)